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Applicant(s) J 

VENOLIA ET AL 
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2641 





- The MAILING DATE of this communication appears on the cover sheet with the correspondence address • 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1.136(a), In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

• If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )M Responsive to communjcation(s) filed on 15 October 2001 . 
2a)n This action is FINAL. 2b)M This action is non-final. 

3) 0 Since this application is in condition for allowance except forfonnal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quay/e, 1935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) 13 Claim(s) 1-33 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) 0 Claim(s) is/are allowed. 

6) 13 Claim(s) 1-33 is/are rejected. 
/)□ Claim(s) is/are objected to. 

8) 0 Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) 0 The specification is objected to by the Examiner. 

10) 0 The drawing(s) filed on is/are: a)n accepted or b)^ objected to by the Examiner 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 

11) 0 The proposed drawing correction filed on is: 3)0 approved b)n disapproved by the Examiner. 

If approved, corrected drawings are required in reply to this Office action. 

12) n The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§119 and 120 

13) n Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 1 9(a)-(d) or (f). 

a)nAII b)n Some*c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2.n Certified copies of the priority documents have been received in Application No. . 



3.n Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) 0 Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 119(e) (to a provisional application). 

a) □ The translation of the foreign language provisional application has been received. 

15) n Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121. 

Attachnient(s) 

4) O Interview Summary (PTO-413) Paper No(s). 



1 ) l2Sl Notice of References Cited (PTO-892) 

2) CH Notice of Draftsperson's Patent Drawing Review (PTO-948) 

3) O Information Disclosure Statement(s) (PTO-1449) Paper No(s) 



5) CD Notice of Informal Patent Application (PTO-152) 

6) 0 Other: 



U.S. Patent and Trademarlt Office 
PTO-326 (Rev. 04-01) 



Office Action Summary 
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DETAILED ACTION 



Claim Rejections - 35 USC §103 



1 . The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

2. Claims 1-3, 13-14, 17-21, and 29 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over VanBuskirk et al (US Patent No. 6,075,534) in view of Tannenbaum (US 
Patent No. 6,233,560). 

3. Regarding claims 1-3, 17-19, 21 and 29 VanBuskirk et al teaches 

A minimal GUI for speech recognition in which the recognized text field and the system 
status visual user feedback component are combined together and can be displayed as embedded 
in the window of an appUcation or can be a floating window at col. 1, lines 63-67, col. 5, lines 7- 
10 and col 2, lines 60-63 

Activating a microphone and displaying an indication that the microphone is active at col. 

4. lines 42-51 and Figures 6 and 7 

Variations in the volume of the user speech is displayed by a ribbon with fixed edge and 
movable edge to alter the shape and altering the color in response to variations in volume of the 
user speech (using speech signal value to determine coordinates of shape of display meter) at col. 
2, lines 15-24. 
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Although VanBuskirk et al teaches a floating window to provide a system status visual 
user feedback component, they do not specifically teach that the floating window should be 
placed near an insertion area. Refer to Tannebaum who teach a method and apparatus for 
presenting proximal feedback of voice commands in which confirmation information is 
displayed on the screen at a location functionally related to the analyzed contents and context of 
the voice input (Abstract). Tannebaum teaches that displaying the confirmation information at 
these areas of the screen avoids distractions associated with fixed location confirmation areas 
(Abstract). 

Therefore, it would have been obvious to one of ordinary skill at the time of invention to 
modify the speech recognition confirmation display system of VanBuskirk et al to implement 
displaying the visual feedback component on the screen in area related to the voice input, as 
taught by Tannebaum, for the purpose of avoiding distractions associated with fixed location 
confirmation areas, as also taught by Tannebaum. 
4. Regarding claims 13, 14, 20, 21, and 29, 

VanBuskirk et al do not specifically teach providing information on recognition status. 
Refer to Tannebaum who teach providing information to the user if the voice recognition 
apphcation has difficulty recognizing an utterance. Tannebaum teaches that in response to the 
voice recognition application ability to recognize the utterance, the confirmation message 
animation is altered (lengthened/shortened) to reflect the recognition status. Tannebaum suggests 
that providing the recognition status notifications allow the user the opportunity to take 
corrective actions to ensure proper application functionality. (Col 5, lines 45-64) 
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Therefore, it would have been obvious to one of ordinary skill at the time of invention to 
modify the system of VanBuskirk et al to implement displaying visual feedback information 
regarding recognition status as taught by Tannebaum, for the purpose of allowing the user to take 
corrective actions to maintain proper application functionality, as suggested by Tannebaum. 

Neither VanBuskirk et al nor Tannebaum specifically teach displaying a volume meter 
close to a recognition status meter. However, VanBuskirk et al teaches that the multiple function 
graphical user interface should supply information is the smallest space possible (col. 3, Unes 49- 
52). 

Therefore, it would have been obvious to one of ordinary skill at the time of invention to 
display the volume meter close to the recognition status meter for the purpose of using the 
smallest space possible when implementing the graphical user interface, as suggested by 
VanBuskirk et al. 

5. Claims 4-16, 20, 22-28, and 30-33 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over VanBuskirk et al and Tannebaum in view of French-St. George et al (US 
Patent No. 6,018,711). 

6. Regarding claims 4-12, 22-28, and 30-33, although VanBuskirk et al teach a shape that 
changes size and color based on the variations of the speech signal volume, neither VanBuskirk 
et al nor Tannebaum specifically teach a mathematical function or relationship that governs the 
rate of change of the graphic display. French-St. George et al teaches animated graphical output 
in which the rate at which the animation diminishes in size is a linear function (abstract; col. 6, 
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lines 60-67; col. 7, lines l-21;col. 8, lines 9-53), for the purpose of improving of user feedback 
and control of the speech interface (col. 5, lines 32-36). 

7. Therefore, it would have been obvious to one of ordinary skill at the time of invention to 
modify the speech recognition graphical user interface of VanBuskirk et al in view of 
Tannebaum to implement animated graphical output in which the rate at which the animation 
diminishes in size is a linear function, as taught by French-St. George et al, for the purpose of 
improving of user feedback and control of the speech interface, as also taught by French-St. 
George. 

8. Regarding claims 15-16 

VanBuskirk et al do not specifically teach providing information on recognition status. 
Refer to Tannebaum who teach providing information to the user if the voice recognition 
application has difficulty recognizing an utterance. Tannebaum teaches that in response to the 
voice recognition application ability to recognize the utterance, the confirmation message 
animation is altered (lengthened/shortened) to reflect the recognition status. Tannebaum suggests 
that providing the recognition status notifications allow the user the opportunity to take 
corrective actions to ensure proper application functionality. (Col. 5, lines 45-64) 

Therefore, it would have been obvious to one of ordinary skill at the time of invention to 
modify the system of VanBuskirk et al to implement displaying visual feedback information 
regarding recognition status as taught by Tannebaum, for the purpose of allowing the user to take 
corrective actions to maintain proper application functionality, as suggested by Tannebaum. 
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Response to Arguments 

9. Applicant's arguments with respect to claims 1-33 have been considered but are moot in 
view of the new ground(s) of rejection. 

Any inquiry concerning this communication or earher communications from the 
examiner should be directed to Angela A. Armstrong whose telephone number is 703-308-6258. 
The examiner can normally be reached on Monday-Thursday 7:30-5:00 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Marsha Banks-Harold can be reached on (703) 305-4379. The fax phone numbers 
for the organization where this appHcation or proceeding is assigned are 703-308-6306 for 
regular communications and 703-308-6296 for After Final communications. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is 703-305-3900. 



AAA 

January 12, 2002 
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